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[57] ABSTRACT 

A cashless toll collection system and method that detects 
vehicles using transponders for prepaid customers and cam- 
eras for casual or non-transponder equipped vehicles. The 
system has a plurality of roadside loll collectors, one or more 
toll transaction processors, and a revenue management sys- 
tem. Each roadside toll collector has a vehicle to roadside 
communications system that communicates with transpon- 
ders disposed in transponder equipped vehicles and gener- 
ates entry and exit transaction reports indicating the entry 
and exit locations and times of the transponder equipped 
vehicles. Each roadside toll collector has a plurality of 
license plate cameras that selectively provide video images 
of license plates of vehicles that are not equipped with a 
transponder. Each roadside toll collector has a vehicle detec- 
tor and classification system that detects the presence of 
vehicles, controls the cameras to capture the video images of 
the license plates, and generates entry and exit transaction 
reports indicating the entry and exit locations and times, and 
the license plate images of each detected vehicle that is not 
equipped with a transponder. The toll transaction processor 
processes the transaction reports to generate tolling trans- 
actions for each vehicle. The revenue management system 
processes the tolling transactions to generate toUs for each 
vehicle and generate bills for use of the toll road. 

6 Claims, 6 Drawing Sheets 
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OPEN ROAD CASHLESS TOLL 
COLLECTION SYSTEM AND METHOD 
USING TRANSPONDERS AND CAMERAS TO 
TRACK VEHICLES 

BACKGROUND 

The present invention relates generally to toll road rev- 
enue collection systems, and more particularly, to an open 
toll road cashless revenue collection system employing 
transponders and cameras to track vehicles. 

Typically, conventional toll roads use manned or 
unmanned toll booths to collect tolls for using the roads. The 
toll booths typically use human operators, which introduces 
the possibility of human errors. Toll booths are lane and 
speed restrictive. A toll booth requires a vehicle to stay in 
one lane, and the vehicle operator must stop and endure the 
inconvenience of a cash transaction, whether by paying a 
human toll collector or by depositing cash in a toll collection 
machine. 

Other conventional toll roads use lane restricted electronic 
toll collection systems. This type of restriction does not 
require vehicles to completely stop although the vehicle 
must usually slow down. This type of system requires the 
construction of barrier lanes and toll booths. The barrier 
lanes and toll booths add to the cost of the infrastructure of 
a toll road. The barriers and lane restrictions force commut- 
ers to slow down, leading to traffic congestion. 

Thus, conventional system either have transponders and 
cash, which requires toll booths and cash handling, or they 
use transponders only, which reduces patronage. 

Accordingly, it is an objective of the present invention to 
provide for an open road toll cashless collection system 
employing transponder and camera tracking of vehicles that 
eliminates the restrictions placed upon drivers by conven- 
tional systems. It is a further objective of the present 
invention to provide for an open road toll collection system 
that tracks vehicles in multiple lanes using transponders and 
cameras and eliminates the need for vehicles to stop or 
reduce speed for fee collection while allowing both tran- 
sponder equipped and vehicles without transponders to use 
the toll road. 

SUMMARY OF THE INVENTION 

To meet the above and other objectives, the present 
invention provides for an open toll road, cashless toll 
collection system that provides for vehicle detection and 
identification using transponders for prepaid customers and 
cameras for casual or non-transponder equipped vehicles. 
The cashless toll collection system discriminates between 
these two types of vehicles and bills the user or owner of the 
vehicle accordingly. The present invention allows highly 
accurate detection of vehicles in multiple lanes while dis- 
criminating between transponder equipped vehicles and 
non-transponder equipped vehicles. 

The system comprises a plurality of roadside toll 
collectors, one or more toll transaction processors, and a 
revenue management system. Each roadside toll collector 
comprises a vehicle to roadside communications system for 
communicating with transponders disposed in transponder 
equipped vehicles and generates entry and exit transaction 
reports that are indicative of the entry and exit locations and 
times of , the transponder equipped vehicles. Each roadside 
toll collector has a plurality of license plate cameras that 
selectively provide video images of license plates of 
vehicles that are not equipped with a transponder. Each 
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roadside toll collector has a vehicle detector and classifica- 
tion system that detects the presence of vehicles, controls the 
cameras to capture the video images of the license plates of 
vehicles, and generates entry and exit transaction reports that 

5 contain data that is indicative of the entry and exit locations 
and times, and the license plate images of each detected 
vehicle that is not equipped with a transponder The toll 
transaction processor is coupled to the plurality of roadside 
toll collectors and processes the transaction reports to gen- 

10 erate tolling transactions for each vehicle. The revenue 
management system is coupled to the toll transaction pro- 
cessors and processes the tolling transactions to compute 
tolls for each vehicle and generate bills for use of the toll 
road. 

15 More specifically, each roadside toll collector has an ID 
reader coupled to a plurality of antennas that transmits frame 
messages to the transponders which decode the messages 
and transmit their respective transponder ID codes. The ID 
reader assigns a time slot in a message frame for each 

20 transponder to transmit the data stored in its memory, and 
reads ID codes and stored data transmitted by the transpon- 
ders. 

The roadside toll collector has a transponder locator that 
processes the ID codes from each transponder to build a 
track file that is indicative of the path of the transponder and 
vehicle. The vehicle detector and classification system 
include a laser-based sensor that generates two fan-beam 
scanning laser beams that are sensed to determine speed, 
height, length and profile of vehicles as they pass there- 
^° through. 

The roadside toll collector includes a processor that sends 
the ID codes of the transponders and the times of entry into 
and exit from the toll road of the transponder equipped 
vehicles, sends the video images of license plates of the 
vehicles derived from the license plate camera of the non- 
transponder equipped vehicles and outputs transaction 
reports relating to each vehicle, and sends a site ID of the 
roadside toll collector to the toll transaction processor. The 
toll transaction processor receives the transaction reports 
from each of the processors in the roadside toll collectors 
and processes them to generate tolling transactions compris- 
ing paired entry and exit times and locations for each 
vehicle. The revenue management system processes the 
tolling transactions to generate tolls for each vehicle. 

The toll collection system thus comprises an over-the-air, 
line-of-sight two-way vehicle to roadside communication 
system. This system transfers data from the vehicle tran- 
sponders to the VRC reader in the roadside toll collector and 

50 from the reader to the transponder. The transponder has a 
read-write memory in which its ID code is stored along with 
other relevant data. The reader continuously outputs frame 
messages in a predetermined radio frequency (RF) band. 
When the transponder moves into a communications zone of 

55 the system, it detects the transmitted reader frame messages, 
the transponder wakes up and attempts to decode the mes- 
sage. When the reader frame message is decoded correctly, 
the transponder is connected to the system, and transmits its 
transponder ID code. The reader then assigns a time slot in 

(SO a message frame in which the transponder transmits its 
memory contents. 

The transponder locator listens to radio frequency (RF) 
transmissions from the transponder. The transponder locator 
uses multiple antennas.with phase array elements to. deter^ 

65 mine the angle of arrival of the transmitted RF signals at 
each antenna. These angle of arrival measurements are 
combined and the geolocation of the transponder is deter- 
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mined. Measurements made at different times and at mul- 
tiple transponder locations are processed to determine a 
track on the road of the path of the transponder 

The vehicle detector and classification system uses lasers 
and associated processing to detect the presence of a vehicle 
in a predefined area of the communications zone defined by 
the two laser beams. The vehicle detector and classification 
system classifies the vehicle once the vehicle has passed 
through the two laser beams. 

The roadside toll collector determines the position of the 
vehicle from data provided by the vehicle detector and 
classification system and correlates the vehicle position with 
track files generated by the transponder locator. ITie roadside 
toll collector identifies transponder equipped vehicles and 
non-transponder equipped vehicles and processes data to 
accurately identify each vehicle. The transponder equipped 
vehicles are processed for billing using their ID codes, while 
license plate images of non-transponder equipped vehicles 
are captured and processed by the toll transaction processor 
and the revenue management system to generate either a bill 
for use of the toll road. 

Thus, since vehicles can be identified and tolled with or 
without the use of transponders, there is no need for cash 
collection of casual non-transponder users. This eliminates 
the need for toll booths, coin machines, and cash handling. 
Thus, the present invention provides for a major improve- 
ment over conventional toll road toll collection systems. 

Vehicles are not restricted to one lane during tolling 
operations, which provides for an "open road" type system. 
A vehicle can change lanes, be in any lane, or straddle lanes 
anywhere between the edges of the road. The system detects 
and generates a transaction report for each vehicle traveling 
through its toll collection area. The present invention thus 
provides for a multiple lane high speed detection system that 
discriminates between transponder equipped vehicles and 
non-transponder equipped vehicles and generates data from 
which bills are generated for use of the toll road. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The various features and advantages of the present inven- 
tion may be more readily understood with reference to the 
following detailed description taken in conjunction with the 
accompanying drawings, wherein like reference numerals 
designate like structural elements, and in which: 

FIG. 1 illustrates a system block diagram of an open road 
toll collection system in accordance with the principles of 
the present invention; 

FIGS. 2a and 2b illustrate top and side views, 
respectively, of an embodiment of a roadside toll collector 
employed in the system of FIG. 1; 

FIG. 2c is a more detailed block diagram of the roadside 
toll collector; 

FIG. 3 illustrates a block diagram showing data flow in 
the roadside toll collector of FIG. 2; and 

FIGS. 4a and 4b show a flow diagram illustrating a 
sequence of events encountered in using the system of FIG. 
1. 

DETAILED DESCRIPTION 

Referring to the drawing figures, FIG. 1 illustrates an 
open road toll collection system 10 in accordance with the 
principles of the present invention. The system 10 comprises 
a plurality of roadside toll collectors 11, or roadside loll 
collection systems II, that are coupled by way of a fiber 
optic network 13 to one and preferably two redundant toll 
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transaction processors 12. The toll transaction processors 12 
are coupled by way of the fiber optic network 13 to a revenue 
management system 14 that interfaces with computers of an 
appropriate motor vehicle authority to obtain license infor- 

5 mation regarding vehicles 17, and bank and credit card 
clearing houses to process bills and receive payments. The 
revenue management system 14 is coupled by way of the 
fiber optic network 13 to point of sale terminals 15 and 
customer service terminals 16. 

jQ Vehicles 17 may contain windshield-mounted transpon- 
ders 18 that communicate with individual roadside toll 
collectors 11 upon entry to and exit from a toll road 19 
(FIGS. 2a and 2b ). The vehicles are detected when they 
enter and exit the toll road 19 which provides data indicative 
of the locations and times of entry into and exit from the toll 
road 19. The transponder 18 transmits transponder identifi- 
cation data to the roadside toll collectors 11 that is correlated 
with the vehicle detection data. The identification data, 
location data, and entry and exit data are processed by the 
roadside toll collectors U to generate transaction reports for 

20 each vehicle 17. The toll transaction processor 12 processes 
the transaction reports to generate tolling transactions for 
each vehicle 17. The tolling transactions are forwarded to 
the revenue management system 14 which generates tolls for 
each vehicle 17 and bills the owner of the transponders 18 

25 for use of the toll road 19. 

However, the present system 10 also permits vehicles 17 
that are not equipped with a transponder 18 to also use the 
toU road 19. Vehicles 17 are detected to determine the time 
of entry into and exit from (the transaction time) the toll road 

30 19. If no transponder 18 is detected, the system 10 uses 
license plate cameras 24 to capture images of the license 
plates 29 of the vehicles 17 (as will be described with 
reference to FIGS. 2a and 2b). The images of the license 
plates 29 are processed using optical character recognition 

35 processing to identify the owner of the vehicle. Vehicle 
ownership data derived from processing the images of the 
license plates 29 are use to bill registered owners of the 
vehicles 17. 

Referring now to FIGS. 2a and 26, they illustrate top and 

40 side views, respectively, of an embodiment of the roadside 
toll collector 11 employed in the system 10 of FIG. 1. Each 
roadside toll collector 11 has two gantries 21 that span the 
entry (and exit) lanes of the toll road 19. A plurality of 
license plate cameras 24 are located on the first gantry 21 

45 that is passed by the vehicles 17 that are used to image the 
license plates 29 of non- transponder equipped vehicles 17. 
A plurality of lights 25 are also disposed on the first gantry 
21 that are used to illuminate the license plates 29 in low 
light level conditions. A light sensor 22 may be disposed on 

50 the first gantry 21, for example, that is used to monitor the 
light intensity at the roadside toll collector U and provide 
feedback signals to the roadside toll collector 11 that are 
used to control shutter, gain, and pedestal settings of the 
license plate cameras 24 during changing lighting conditions 

55 that affect the quaUty of the imaged license plates 29. 

A plurality of vehicle detector and classification (VDAC) 
systems 26 are disposed on the second gantry 21 along with 
a plurality of VRC antennas 28 that transmit and receive RF 
signals that communicate with the transponders 18 in tran- 

60 sponder equipped vehicles 17. A plurality of transponder 
locator antennas 27 is also disposed on the second gantry 21 
that are used to locate transponders 18 in the vehicles 17. 
Each of the vehicle detector and classification systems 26 
include a laser-based sensor that generates a dual fan-beam 

65 scanning laser beam that is used to determine the speed, 
height, length and profile of vehicles 17 as they pass a toll 
collection zone. 
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A roadside control station 23 is disposed adjacent to the bits. This read-only data storage is designed so that it 

toll road 19 in the vicinity of the gantries 21. The roadside permanently stores the ID code or serial number code in the 

control station 23 comprises a vehicle-roadside communi- transponder 18. However, only the 32-bit public ID can be 

cations (VRC) reader 23a, an application processor 23^?, and read out of the transponder 18. The transponders 18 also 

a transponder locator 23c. The VRC reader 23^, application 5 have agency re-programmable data fields that may be used 

processor 236, and transponder locator 23c are coupled to to store agency and vehicle classification information. The 

each other and transmit data and commands therebetween as transponders 18 have a scratch pad memory that permit 

required to process transactions within the roadside toU various communications functions. The main function of the 

collector 11. The application processor 236 is also coupled ^^^^^ ^ ^^^^^ ^^^^ ^^t^ 

to the hcense plate cameras 2^^ ^^^^^^ determination and transaction completion. 

22, and the vehicle detector and classification systems 26. ^ 

The VRC reader 23^ is coupled to the VRC antennas 28 and Referrmg now to FIG. 3, it lUustrates a block diagram 

is used to read each identification code (ID) transmitted from showing data flow in the roadside toll collector 11 of FIG. 

the transponders 18 and write data to the transponders 18. 2. The operations illustrated in FIG. 3 are self explanatory. 

The transponder locator 23c is coupled to transponder , Th^ roadside toll collector 11 correlates data derived from 

locator antennas 27 which cooperate to locate the transpon- ^'^^ independent processes that operate within the roadside 

ders when they pass through the toll coUection zone. ^""^ collector 11 to identify each vehicle 17. Data derived 

HG. 3c shows a more detailed block diagram of the transponders 18 are suppUed to the VRC reader 

roadside toll collector 23 depicted in FIGS. 2a and 2b. The i^^:^^,^ ^ transponder 18 enters the communication zone, 

VRC reader 23a includes redundant VRC processors 23a-l, identification ID) number o the transponder 18 is read, 

23a-2 that are coupled by way of one or more transmit/ '° transponder 18 is then tracked and track data is accu- 

receive modules 23^-3 to the VRC antennas 28. The VRC ^^^^^^^ transponder locator 23c, Vehicle position 

processors 23a-l, 23a-2 execute a slotted aloha time divi- ^^^^ ^^^^^ ^'^"^ ^^^^^^ detector and classification 

sion multiple access (TDMA) protocol discussed below to ^y^^^"^ ^6 to the apphcation processor 236 for processing, 

communicate with the transponders 18 by way of the The various operations performed by the respective com- 

transmit/receive modules 23a-3 and VRC antennas 28, The ponents of the roadside toll collector 11 and the overall 

VRC reader 23a outputs transponder data to the application operation of the>system 10 will be better understood with 

processor 236 which combines this data with transponder reference to FIGS, 4a and 46. FIGS. 4a and 46 show a flow 

location data to provide a transponder ID and road location diagram illustrating a chronological sequence of events 40 

record referred to herein as a transaction report. FoUowing 3^ that occurs when vehicles 17 interact with the system 10 of 

a short burst of transmissions used to obtain data from the F^G, 1. 

transponder 18, the VRC reader 23a commands the tran- The first steps in the method 40 involve reading and 

sponder 18 to transmit an RF burst once every few frames authenticating the transponder 18. The VRC reader 23fl 

to allow vehicle location updates to be made until the vehicle continuously transmits reader frame messages in a prede- 

17 is detected by the vehicle detector and classification termined radio frequency (RF) band by way of the VRC 

systems 26. When the application processor 236 determines, antennas 28 within a limited distance communications zone 

based on transponder location data, that the transponder 18 (i.e., the vicinity of the roadside toll collector 11). As a 

is in the toll collection zone, the VRC reader 23c is transponder-equipped vehicle 17 approaches the communi- 

instructed to write entry data back to the transponder 18. cations zone, the transponder 18 in the vehicle 17 detects the 

The vehicle detector and classification system 26 transmitted RF energy and "wakes up". The transponder 18 

employed in a reduced to practice embodiment of the system then attempts to decode the reader frame messages. When 

10 is manufactured by Schwartz Electro Optics. The tran- one of the reader frame messages is decoded correctly, the 

sponder locator 23c employed in the system 10 is described transponder 18 transmits 41 its identification code (ID) to 

in U,S, Pat. No. 5,227,803 assigned to the assignee of the the VRC reader 23a, 

present invention. ^5 The VRC reader 23flE then receives 42 the ID from the 

The transponders 18 each have a unique ID number or ID transponder 18, and assigns 43 a time slot in a frame to the 

code assigned to them, which is used for identification transponder 18. The transponder 18 then transmits 44 its 

purposes. The transponders 18 communicate with the VRC memory contents (ID code and other stored data) in that time 

reader 23fl using the slotted aloha TDMA communications slot. The VRC reader 23a and the transponder locator 23c 

protocol that permits communication with a large numbers 50 simultaneously receive 45 the memory contents transmitted 

of transponders 18 at the same time, and performance of the by the transponder 18. 

system 10 using this protocol is independent of lane position If the transmitted message is correctly decoded by the 

of the vehicles 17. Successful communications is possible VRC reader 23fl indicating that a valid message was 

with closely spaced vehicles 17 at speeds up to about 150 received, the VRC reader 23a sends 46 the transponder ID 

miles per hour. The slotted aloha TDMA communications 55 and time slot number to the transponder locator 23c. The 

protocol is described in U.S. Pat. Nos. 5,307,349 and VRC reader 23a also sends 47 the memory contents trans- 

5,425,032, assigned to the assignee of the present invention. mitted by the transponder 18 to the application processor 

Each of the above-cited U,S, patents is incorporated herein 236. 

by reference in their entirety. Based upon data from the transponder locator 23c, it is 

The transponders 18 operate in the 902-928 MHz band, 60 determined 49 if the transponder 18 has reached a region of 

and at a nominal frequency of 915 MHz. The transponder interest. Typical regions of interest include the toll region, 

messages contains 512 binary digits (bits), and a Manchester and an out-of-bounds region indicating transponder is on 

encoding technique is used for data communications. The another roadway. Then steps 43-49 are repeated until it is 

. . data communications rate between the transponders IS.and -^.determined 52.that the region of interest is the toll collection 

the ID readers 23d is about 500 kilobits per second, 55 zone. Thus, the VRC reader 23fl assigns 43 the transponder 

The transponders 18 have a factory-programmed read- 18 another time slot in which to retransmit 44 its memory 

only data field consisting of 32 public bits and 32 private contents. The VRC reader 23^2 and the transponder locator 
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23c process 45 the retransmitted memory contents. This transponder locator 23c. The correlation region and the time 

process is repeated so that the transponder locator 23c can differential provide "an area in time" for the transponder 

build the track file for the transponder 18. These steps are locator 23c. 

repeated until the vehicle 17 enters 49 the predefined region l^e transponder locator 23c searches its track files to 
of interest or is no longer in the toll collection zone. If the 5 determine 66 if any transponders 18 were in the correlation 

vehicle 17 leaves the toll road 19, eventually the ID number region at the time provided by the application processor 23b. 

of the transponder 18 becomes inactive and is purged 53. If If one or more transponders 18 were in the correlation 

the transponder 18 enters or exits 49 a predefined region of region, the transponder locator 23c sends the transponder 

interest, the transponder locator 23c sends a message to alert ID(s) to the application processor 236. The appUcation 
the VRC reader 23a of this event. lO P^^essor 236 will not take any video images for that vehicle 

If the region entered by the transponder 18 is a toll ^^If there is no correlation between the data from the vehicle 

collection region the VRC reader 23a processes the tran- ^^^^^^^^ classification system 26 and the transponder 

sponder eqmpped vehicle 17 for toll collection. Other pre- y^^^^^^ 23c tracking data, the application processor 236 

defined regions may have different processes depending calculates the coordinates of the rear of the vehicle 17, and 
upon the configuration of the site. Typically, transponders 18 15 appj-op^ate cameras 24 are selected 67 to image the vehicle 

entering out-of-bounds regions are purged from further license plate 29. An image of the rear license plate 29 of the 

processing. The application processor 236 writes 54 an entry vehicle 17 is captured 68 when the vehicle detector and 

or exit message to the transponder 18 via the VRC reader classification system 26 sends a trigger message to the 

23a, This process sends data from the application processor application processor 236 (as the rear of the vehicle 17 
236 via the VRC reader 23a and VRC antennas 28 to the 20 pasggg ^^e second laser beam). 

transponder 18. The transponder 18 receives the data, veri- ^^er the vehicle 17 has passed both laser beams, the 

fies Its authenticity, then wntes the received data mto its yQ^^ide detector and classification system 26 sends a clas- 

memory. sification report message to the application processor 236. If 

The application processor 236 optionally activates 55 a U-ansponder 18 has been correlated to the messages from 

audio or visual indicators on the transponder 18 via the VRC the vehicle detector and classification system 26, its data is 

reader 23fl. The VRC reader 23a continues to assign 56 coupled to the vehicle detection data. If image(s) were 

traasmit time slots to the transponders 18 of all transponder captured, the vehicle detection and classification data is 

equipped vehicles 17 that are tracked. The transponder 18 coupled to the image. 

transmits 57 the message, and the VRC reader 23a authen- a vehicle transaction report is then generated 71 for the 
ticates and acknowledges the message. The VRC reader 23fl vehicle 17. This report is sent from the application processor 
sends 58 the ID, frame, and time slot data to the transponder 236 to the toll U-ansaction processors 12. Entry and exit data 
locator 23c. The application processor 236 sends the ID can then be matched up in the toll transaction, processors 12. 
number and time slot number of the authenticated messages if necessary, license plate images are sent from the appli- 
to the transponder locator 23c which tracks 59 the location cation processor 236 to the toU transaction processors 12 
of the transponder 18 by ID number. Steps 56-59 are that correspond to the vehicle 17 and the transaction report, 
repeated 61 until there is a vehicle 17 detected by the vehicle x^us, the present invention provides for a system 10 that 
detector and classification system 26. implements a closed toll road 19 using an all-electronic. 
As a vehicle 17 passes through the toll collection zone, non-stop "invisible gate" approach to identify vehicles 17 
one or more vehicle detector and classification system 26 entering and exiting from the toll road 19. Vehicles 17 are 
(depending upon where the vehicle 17 is located) detects 62 identified using in-vehicle transponders 18 with read/write 
the vehicle 17 and sends one or more vehicle detection capabihty, and that communicate via radio frequencies, 
messages to the application processor 236. The application Vehicle detection and classification is achieved using lasers 
processor 236 checks 63 to see if there are detection mes- and sensors, and cameras 24 are used to record high- 
sages from more than one vehicle detector and classification resolution digital images of the license plates 29 of vehicles 
system 26, and joins the messages to produce a composite 17 that have no transponders 18. 

detection. Dual toll transaction processors 12 use computer and 

The vehicle 17 is detected 64 by the vehicle detector and image processing technology to match the toll road 19 exit 

classification system 26, which sends a vehicle detection and entry transactions. This is done with transponder data or 
update message to the application processor 236 when the 50 by identifying license plate numbers derived from the video 

vehicle 17 passes the second laser beam provided by the images, to match entry and exit images for each vehicle 17 

vehicle detector and classification system 26. In the vehicle not having a transponder 18. The toll transactions and 

detection update message, the vehicle detector and classifi- required video images are transmitted to the central revenue 

cation system 26 provides the position of each side of a management system 14 for processing. The revenue man- 
vehicle 17. In cases where the vehicle 17 is detected by two 55 agement system 14 receives tolling transactions (paired 

vehicle detector and classification systems 26, the left and entries and exits and exceptions) from the toll transaction 

right edges of the vehicle 17 are calculated from the respec- processors 12 and computes the appropriate tolls depending 

tive sensors of the vehicle detector and classification system on distance traveled, time of day, account type, vehicle 

26. The application processor 236 determines if two simul- classification and other pertinent variables, 

taneous detections or detection updates are associated with The roadside toll collectors 11 are installed entirely above 

one or two vehicles 17. the road surface and thus do not require cuts or component 

The apphcation processor 236 calculates 65 the position installation in the pavement. This leads to higher reliability, 

of the vehicle 17 based upon the input data from the vehicle easier maintenance, less interference with trafiSc during 

detector and classification system 26, The application .pro- preventive and emergency maintenance, and longer pave- 
cessor 236 calculates an area occupied by the vehicle 17 65 ment life. 

(correlation region). The application processor 236 then The slotted aloha TDMA communications protocol per- 

sends the correlation region with a time differential to the mits communication with multiple transponders 18 simul- 
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taaeously on one frequency, which provides very efficient Thus, the following steps are used in toll road entry 

use of the assigned frequency band, and only one narrow transactions for transponder equipped vehicles 17. The 

frequency band is required for communications with tran- memory contents of the transponder 18 is read and authen- 

sponders 18. This spectral efficiency minimizes interference ticated. The measured classification determined by the 
from other sources, and low transmission power and low 5 vehicle detection and classification system 26 is sent to the 

transmitter duty cycle increase RF safety with respect to application processor 236 for processing. The measured 

personnel exposures to 915 MHz frequencies. classification is then compared with the classification stored 

The roadside toll collectors 11 provide an audit trail count in the transponder 18. An entry message is then written into 

of all passing vehicles 17, a classification verification for all the scratch pad memory of the transponder 18. A transaction 

vehicles 17, and a digitized video image of non-transponder report is then sent to the toll transaction processor 12. 

equipped vehicles 17. The vehicle detection and classifica- At exits, the following steps are carried out for transpon- 

tion system 26 uses laser-based sensors mounted over the der equipped vehicles 17. The memory contents of the 

road 19 that provide the audit trail count and vehicle transponder 18 is read and authenticated. The measured 

classification. The dual fan-beam scanning laser having a classification determined by the vehicle detection and clas- 

calibrated field of view is used to determine the speed, sification system 26 is sent to the apphcation processor 236 

height, length and profile of vehicles 17 as they pass the toll ^r processing. An exit message is then written into the 

point. This information provides vehicle count, vehicle ^^^tch pad memory of the transponder 18. An transaction 

separation,detectionoftrailersandattachedvehiclesl7,and '^^""'^ ^^^n sent to the toll transaction processor 12. 

a measurement of the size of individual vehicles 17 and Appropriate transaction stanis me^ages are communicated 

vehicle com onents vehicle 17 via the transponder 18. 

™ ' ^_ . «- • The logic for the above -delineated steps is as follows, (a) 

-nie toll transaction processor 12 provides traffic mom- transponder 18 is on the exception Ust, video images 

tormg and transaction processmg functions. The traffic ofthelicenseplateof the vehicle 17 Tre captured, (b) If there 

monitormg is a near real-time process earned out in the toll ^ ^ ^^^^ mismatch on entry to the toll road, a violation 

transaction processor 12 that computes the average speed for ^^^^^^ ^ generated that is sent to other roadside toll coUec- 
each completed transponder exit transaction. Transaction 25 torsll.(c)If a class violator is detected at an exit as reported 

processing includes determination of road usage information in (b), video images of the Hcense plate of the vehicle 17 are 

required to compute the customer toll charge. This informa- captured. 

lion includes transponder 18 or license number, entry and If vehicles 17 are not equipped with valid transponders 18 

exitpoints,timeofday,date, for example. The exit message then processing is done using the vehicle detection and 

sent to the toll transaction processor 12 is a composite of the classification system 26 and hcense plate image capmre 

entry data read from the transponder 18, and the exit systems. Transponder transactions for customers with 

information. vehicle classification inconsistencies or for exceptions list 

Processing at the toll transaction processor 12 of the transponders 18 are supplemented by vehicle image data 

digitized video images obtained from occasional customer (i ^- converted into image transactions), 
or non-compliant transactions includes several steps. A 35 The steps involved in the processing of a non-transponder 

pattern matching system is used in the toll transaction equipped or no-balance, lost, stolen or misclassified vehicle 

processor 12 to isolate the image of the license plate 29 17 are presented below. The presence of the vehicle 17 is 

within a full frame or frames of video data. Once the image detected, and its speed and classification is determined. Any 

of the license plate 29 is isolated, it is processed by optical transponder data that may be present is then read. Classifi- 
character recognition (OCR) software to determine the 40 cation data for the vehicle 17 is sent to the processor 23/?. 

actual license plate number. Employing multiple processing Video images of the license plate 29 of the vehicle 17 are 

algorithms, fused into a best-fit resuU, the OCR software captured. The images and available transponder data are sent 

returns the license plate number, along with confidence to the toll transaction processor 12 for determination of the 

ratings on each character read. If this was a video image appropriate toll. 

captured upon entry, it is stored temporarily, awaiting 45 Thus, an open road cashless toll collection system has 

match-up with the corresponding exit image captured when been disclosed that tracks vehicles in multiple lanes using 

the vehicle 17 leaves the toll road 19. transponders and cameras and eliminates the need for 

When the vehicle 17 exits the toll road 19, and the video vehicles to stop or reduce speed for fee collection. It is to be 

image is forwarded to the toll transaction processor 12, the understood that the described embodiments are merely illus- 
license number is determined in the same manner as at entry, 50 trative of some of the many specific embodiments which 

and then the license number is compared against the tem- represent applications of the principles of the present inven- 

porarily stored entry license numbers to locate the matching tion- Clearly, numerous and other arrangements can be 

entry. Assuming a match is found, the paired image data is readily devised by those skilled in the art without departing 

then forwarded to the revenue management system 14 for from tbe scope of the invention, 
toll determination and billing. 55 ^^^^ ^ claimed is: 

For cases where a match is not found, or a low-confidence 1- ^ method of determmmg tolls for use of a toll road for 

match is obtained due to unreadable characters on the vehicles containing transponders and for vehicles that do not 

hcense plate 29 (due to dirt or objects blocking the plate 29), ^o^^ain transponders, said method comprising the steps of: 

the pattern matching system in the toll transaction processor detecting vehicles on the toll road and generating area 

12 is used to compare the exit license plate image with 60 data indicative of the particular position of a vehicle on 

candidate entry hcense plate images to produce a high- roadway and detection time of each vehicle at such 

confidence video image entry/exit pair based on video position; 

correlation matching of the two license plate images. The processing transponder ID codes for a transponder- 
confirmed pair is then forwarded to the revenue management equipped vehicle; 

system 14 for manual evaluation. Unmatched cases are 65 detecting the location of transponders associated with 

forwarded to the revenue management system 14 after a vehicles on the toll road and generating location data 

predetermined time period and are manually evaluated. indicative of the location of the transponders; 
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determining whether a vehicle is a transponder-equipped 

vehicle by examining whether a correlation exists 

between the area data and the location data; 
generating transaction reports for the transponder- 
equipped vehicles comprising information about a 

vehicle's travel on the toll road; 
generating video images of license plates of vehicles that 

do not contain a transponder; 
processing the video images of the hcense plates to 

determine the license plate numbers of the vehicles that 

do not contain a transponder; 
generating transaction reports for the vehicles tat do not 

contain transponders comprising information about a 

vehicle's travel on the toll road; and 
processing the respective transaction reports associated 

with each vehicle to determine tolls for the use of the 

toll road, and when a vehicle does not contain a 

transponder, performing the steps of: 

isolating an image of the license plate of the vehicle 
derive from data obtained at the first individual 
location within one or more frames of video data 
using a pattern matching system; 

processing the isolated image of the license plate 
obtained at the first individual location using optical 
character recognition software to determine the 
actual plate number; 

isolating an image of the license plate of the vehicle 
derived from data obtained at the second different 
individual location within one or more flames of 
video data using the pattern matching system; 

processing the isolated image of the license plate 
obtained at the second different individual location 
using optical character recognition software to deter- 
mine the actual plate number; and 

comparing the two actual license plate numbers to 
confirm that they match; 



25 



processing nonvideo data contained in the transaction 
reports to determine the tolls for use of the toll road. 

2. The method of claim 1 wherein the steps of processing 
the video images of the license plates each comprise the step 
of: 

processing the video images of the license plates using an 
optical character recognition program to determine the 
license plate numbers. 

3. The method of claim 1 wherein the steps of detecting 
vehicles further comprises the step of detecting the vehicles 
using a plurality of laser beams. 

4. The method of claim 3 wherein the step of detecting 
vehicles comprises processing signals derived from the 
pluraUty of laser beams to determine the speed, height, 
length and profile of the vehicles. 

5. The method of claim 1 wherein the steps of processing 
transponder ID codes for transponder-equipped vehicles 
each comprise the step of: 

communicating with the transponders using a slotted 
aloha time division multiple access communications 
protocol. 

6. The method of claim 1, the step of comparing the two 
actual license plate numbers further comprising the steps of: 

in cases where a match is not found, or a low confidence 
match is obtained; 

comparing the image of the license plate obtained at the 
second different individual location with candidate 
images of license plates that potentially match using 
video correlation matching of the license plate images; 
and 

manually evaluating the correlation matched license plate 
images to determine an actual match. 
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